Possible reasons:
1: Guilty Conscience (like you said)
2: Shy (kind of like you said)
3: Classified as a 'Sexual Predator' by the body of elders (such ones usually aren't allowed privileges beyond preaching per instructions from headquarters)
4: He Knows TTATT